00 

o 

O 



oo 

< 

IX, 



Firmly nonexpansive and Kirszbraun- Valentine extensions: 
a constructive approach via monotone operator theory 

Heinz H. Bauschke* and Xianfu Wangt 

July 8, 2008 

Dedicated to Alex Ioffe and Simeon Reich, 
on the occasion of their 70th and 60th birthdays 



Abstract 



Utilizing our recent proximal-average based results on the constructive extension of monotone 
operators, we provide a novel approach to the celebrated Kirszbraun- Valentine Theorem and to 
the extension of firmly nonexpansive mappings. 
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1 Introduction 

X 

Throughout, A is a real Hilbert space with inner product (-, •) and associated norm || • ||. 
Definition 1.1 Let S C X and letT: S — > X. Then T is nonexpansive if 

(Vz G 5)(Vy G S) \\Tx-Ty\\ < \\x - y\\. (1) 

See, e.g. |12|. I13| for further information on nonexpansive mappings. Let us recall the celebrated 
Kirszbraun- Valentine Theorem (see |14| [241 I25j). which states that every nonexpansive mapping 
can be extended to the entire space. 
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Fact 1.2 (Kirszbraun- Valentine) Let S C X and let T: S — > X 6e nonexpansive. Then there 
exists a mapping T: X — > X suc/i £/ia£ T is nonexpansive and T\$ = T. 

In this note, we present constructive approaches to the Kirszbraun- Valentine extension theorem 
for nonexpansive mappings. Our main tool is the proximal average, which is used to provide an 
explicit maximal monotone extension of any monotone operator. In Section O we give maximal 
monotone extensions with "small domains" under some mild constraint qualifications. Our exten- 
sion results for firmly nonexpansive and for nonexpansive mappings are presented in Section [31 In 
some cases, it is possible to provide constructive extensions with an optimally localized range. 



2 Firmly Nonexpansive Mappings and Monotone Operators 

Definition 2.1 Let SCI and let F: S — ► X. Then F is firmly nonexpansive if 

(Vcc G 5)(Vy G S) \\Fx-Fy\\ 2 <{Fx-Fy,x-y). (2) 

The Cauchy-Schwarz inequality implies that every firmly nonexpansive operator is nonexpansive. 
The next result, which is well known (see, e.g., |X2(, Theorem 12.1]), provides a bijection between 
nonexpansive and firmly nonexpansive mappings. 

Fact 2.2 Let S C X, letT: S -> X, and let F: S -> X. Suppose that F = ±Id+|T. Then T is 
nonexpansive <& F is firmly nonexpansive. 

Remark 2.3 Note that (see also [15]) the linear relationship between graT and grai 7 . In fact, 
the linear operator (x,y) i— ► {x, hx + iy) provides a bijection from graT to gra-F with inverse 
(x,y) i— > (x, 2y — x). 

Definition 2.4 Let A: X =£ X, i.e., A is a set-valued operator from X to the power set of X. 
Denote the graph of A by gra^4 := {(#, x*) G X x X | x* G Ax}. Then A is monotone if 

(y(x,x*) G gi&A)(V(y,y*) G gra^) (x - y,x* - y*} > 0. (3) 

If (x,x*) G X x X and the operator with graph {(x,x*)} U gra^4 is monotone, then (x,x*) is 
monotonically related to gr&A. If A is monotone and every proper extension of A fails to be 
monotone, then A is maximal monotone. The inverse operator A -1 is defined via gr&A^ 1 := 
{(x*,x) eX xX | x* £Ax}. 

Maximal monotone operators play a critical role in modern Analysis and Optimization; see, e.g., 

©ED [221 USE)]. 

The following result, brought out fully by Eckstein and Bertsekas |10] , has its roots in the seminal 
works by Minty [17J and by Rockafellar |20j. 



Fact 2.5 Let A: X =£ X, let S Q X, and letF: S ->• X. Suppose that F = (^4+Id)" 1 ; equivalently, 
that A = F^ 1 — Id. Then the following hold. 

(i) A is monotone 44> F is firmly nonexpansive. 
(ii) A is maximal monotone 44> F is firmly nonexpansive and S = X. 

Remark 2.6 Using notation of Fact 12.51 we recall the linear relationship (see [15]) between the 
graphs of F and A. Indeed, the linear operator (x,y) i— ► (y,x — y) provides a bijection from graF 
to gra^4 with inverse (x,y) i— > {x + y,x). Recalling Remark 12 .3^ we observe the linear relationship 
from graT to gra^4 via (x, y) h- > -^{x + y, x — y) with inverse (x, y) h- ► (x + y, x — y). 

Corollary 2.7 Let F: X — > X 6e firmly nonexpansive. Then ranF is convex. 

Proof. Set A := T _1 — Id and observe that dom^ = ranT. The conclusion now follows from 
Fact E3J(ii) and [221 Theorem 18.6]. ■ 

Remark 2.8 Suppose that X = R 2 , let Pa the projector onto the line Kx{l) and let Pb be the 
projector onto the closed unit ball. Then Pa and Pg are both (firmly) nonexpansive (see, e.g., 
[121 Theorem 12.2]). Set T := PbPa- Then T is a nonexpansive mapping defined on the entire 
Euclidean plane; however, ranT is equal to the the closed upper half circle, which is not convex. 

The following result, originally obtained with the help of the proximal average, the Fitzpatrick 
function, and other tools from Convex Analysis, is of key importance. We refer the reader to 
[2 El [U [3 [7] for further information on the proximal average, to [U [HJ [TBI HH1 [23] and the references 
therein for results on the Fitzpatrick function, and to [201 I2~T1 [26] for the basic theory of Convex 
Analysis. The notation A for the maximal monotone extension of a monotone operator A: X =$ X 
will be used from now on. 

Fact 2.9 (See /7, Fact 5.6 and Theorem 5.7].) Let A: X zz| X be monotone. Recall that the 
Fitzpatrick function of A is the function on X x X defined by 

$a: (x,x*)^ sup ({x,a*} + (a,x*) - (a,a*)), (4) 

(a, a* )Ggra A 

with Fenchel conjugate 

®* A :(y*,y)^ sup ({x,y*} + (y,x*) - & A (x,x*)). (5) 

(x,x*)£XxX 

Set 

V A :(x,x*)^ min {h^A(y,V*) + ^ A (z*,z) + ^{\\y-z\\ 2 + \\y*-z*\\ 2 )), (6) 

(x,x*)=2(y+z,y*+z*) 

which is the proximal average between &a and the (transpose of the) <&**, and define A: X z4 X 
via 

graA = {{x,x*) G X x X \ (x*,x) G d^ A {x,x*)}, (7) 

where "d" denotes the subdifferential operator from Convex Analysis. Then the following hold. 



(i) (V(x,x*) G X x X) $>a(x,x*) > (x,x*). 
(ii) (\/(x,x*) e X x X) x* £ Ax 4^ ^ A {x,x*) = (x,x*). 
(iii) A is a maximal monotone extension of A. 

It is convenient (see, e.g., Example 13.31 below) to be able to use the following alternative descrip- 
tion of A. 

Theorem 2.10 Let A : X =$ X* be monotone. Define B : X =$ X* via 

x* G Bx 44> (x,x*) = \{x\ + x 2 ,xl + x* 2 ), (8) 

where 

(x 2 ,x 2 ) G 8^a(.xi,x*) and x\ — x 2 = x\ — x 2 . (9) 

Then B = A. 

Proof. Take (x, x*) G X x X. 



"gra^4 C gra-B": Suppose that (x,x*) G graA Then ^a(x,x*) = (x*,x) by Fact I2.9|(ii)| and, 
by (JTJ), there exist (xi,x*) and (x 2 ,x 2 ) in X x X such that 

(x,x*) = \{x\ + x 2 ,x\ + x* 2 ) (10) 

and 

\(x 1 +x 2 ,x* 1 +x 2 ) = i$ A (xi,xl) + l<S>* A {x 2 ,x 2 ) + |(||xi - x 2 || 2 + Har* - x* 2 \\ 2 ). (11) 

The Fenchel- Young inequality yields $a(.%1)%i) + ^(x?;,^) > ((xi,x*), (x|*,X2)) = (xi,x 2 ) + 
(x*,X2). Hence, (fTTj) results in 

l(x 1 +x 2 ,x* 1 +x* 2 ) > \{xi,x* 2 ) + \{x\,x 2 ) + \{\\ Xl - x 2 f + \\x\ - x* 2 f); (12) 

equivalently, 

111 Il2 I In * *||2 - / * *\ /io\ 

|||Xl — X2|| +2ll X l — X 2\\ ^ \ x l ~ X 2,X 1 — X 2 ). (13) 

Thus, x\ — x 2 G 9(2 1| • || 2 )(xi — x 2 ) and hence 

x* — x 2 = x\ — x 2 . (14) 

In view of (pi]) and flU]), it follows that 

~{x\ + x 2 ,x\ +x* 2 ) = $a(xi,x*) + ^*a(x 2 ,x 2 ) + \{x\ -x 2 ,x* - X* 2 ) , (15) 

i.e., $ A {xi,x\) + <$> a (x* 2 ,x 2 ) = (xi,x%) + (x 2 ,x|) = {(x 1 ,x\),(x* 2 ,x 2 )) and hence 

(x* 2 ,x 2 )ed^ A {x 1 ,x* 1 ). (16) 

Combining (|ID|) . ([To]) , and flH|), we see that (x,x*) G grai?. 



"grai? C graA": Suppose that (x,x*) G gr&B. Then there exist (xi,x x ) and (x2,x|) in X x X. 
such that ([lOJ) and @ hold. Note that © yields 

^(a?i, xj) + $a(4, x 2 ) = (ar l9 x* 2 ) + (sj, x 2 ) (17) 
and 

111 Il2 I In * *||2 / * *\ { i o\ 

2 |pi - x 2\\ +2\\ X l~ X 2\\ = \ x l~ x 2-, x l~ x 2l- (18) 

Using (dUl), (dB, and ([15]) . we obtain 

(x,x*) = |(x 1 + s 2 ,x* + a;2> ( 19 ) 

= \$a{x\,x\) + \& a (xI,X2) + \(x\-xI,xi-x 2 ) (20) 

= ^(xi,x|) + 5®a(x* 2 ,x 2 ) + |(||xi - x 2 || 2 + ||xj - x^ 2 ). (21) 



Using this, ([6]), and Fact I2.9j(i)| we estimate 

{x,x*} = \^ A { Xl ,x\) + \& A {x* 2 ,x 2 ) + |(||xi - x 2 || 2 + ||xj - x^ 2 ) (22) 

>V A (x,X*) 

> (x,x*), 

and we see that V A (x,x*) = (x,x*). By Fact I2.(^n)| (x,x*) G graA ■ 

Example 2.11 Let (a, a*) G X x X and let A: I =| I be given by gravl = {(a, a*)}. Then 
graA = {(x,x + a* - a)} xe x- 

Proof. In view of ((3]), we see that 

$4: X ^R: (x,x*)^ (x,a*) + (a,x*)-(a,a*) = ((x,x*), (a*, a)) - (a,a*). (23) 

Since 6<&a = (a*, a), Theorem 12. 101 implies 

graA = {5(2:1 + a,xi - a + 2a*) \ x\ G X). (24) 

The change of variable x = 2(^1 + a ) now yields the result. ■ 

Note that in Example 12.111 the domain of the extension A is the entire space X while the 
domain of the given operator is a singleton. This raises the question on finding extensions with 
the smallest possible domain. Let A: X =£ X be monotone and set D := convdomA Denote 
the normal cone operator to D by Nd; i.e., Nd = Old so that domiVD = D and (Vx G D) 
N D (x) = {x* G X I sup(L> - x,x*) < 0}. Since (Vx G D) G N D (x), the operator 

A + N D (25) 

is monotone extension of A. However, A + Nd may fail to be maximal monotone: consider, e.g., 
the case when A is the zero operator restricted to the open unit ball. The following result will aid 
us in our quest to provide a sufficient condition for (|25|) to be maximal monotone. 



Fact 2.12 (See |7| Theorem 2.14 and Theorem 2.15].) Let A: X z4 X be monotone, and set 
D := conv dom A. Then the following hold. 

(i) (x,x*) € X x X is monotonically related to gra(A + No) < ^ > 

(x,x*) is monotonically related to gra A and xG f 1 (a + Tn(a)), (26) 

agdom A 

where To (a) = N^(a) is the polar (negative dual) cone of Nd{o). 

(ii) If conv dom A is closed, then PlaedomA( a + ^b(a)) = -D- 

Theorem 2.13 Lei A: X ^ X be monotone, set D := conv dom A and Ap := A + A^. ITien the 
following hold. 

(i) ^4/5 is a maximal monotone extension of A, and 



dom Ad = conv dom Ad C f 1 (oH-Td(o)). (27) 

a£dom A 



(ii) If conv dom A is closed, then dom. Ad = D. 
Proof. Note that dom. Ad = dom A n domiV/) = dom A flD = dom A 



By Fact I2.9](iii) Ad is a maximal monotone extension of Ad- On the other hand, Ad is 
a monotone extension of A. Altogether, Ad is a maximal monotone extension of A. Fact I2.12j(i)| 
yields dom Ad C f]aedomA( a + ^~b( a ))- Since the last intersection is closed and convex, we obtain 
the inclusion in (|27p . Finally, the maximal monotonicity of A^> and |22| Theorem 18.6] imply that 
conv dom Ad = domAp. 



(ii) : Combining (i) and Fact I2.12j(ii)| we deduce that 



D = conv dom A C conv dom Ad = dom Ad C [j (a + Td{cl)) = D. (28) 



aGdom A 

The proof is complete. 



Remark 2.14 In Theorem I2.13f(ii)| the set conv dom A is closed whenever one of the following 
holds. 

(i) dom A is a finite subset of X. 
(ii) X is finite-dimensional, and dom A is closed and bounded. 

We conclude this section with a second approach that tailored to finite-dimensional spaces. 



Theorem 2.15 Suppose that X is finite- dimensional, and let A X =£ X be monotone. Suppose 
that (after translation if necessary) G riconv domi = riconv dom A i.e., G inty conv domi, 
where Y := affdomA = spandomA is a closed subspace of X. Let P: X — > X be the linear 
orthogonal projector onto Y , and let Q: X — > Y : x i— > Px. Then P* = P and Q* : Y — > X : y h^ y. 
Finally, set D := conv dom A Then the following hold. 

(i) The composition PA : Y =4 Y is monotone. 
(ii) If B: Y ^Y is a maximal monotone extension of PA (e.g., B = PA), then 

B:=Q*BQ + N D :X^X (29) 



is a maximal monotone extension of A and domB = D. 



Proof, (i) Take (yi,y*) and (2/2)2/2) m graA Since P* = P, dom A C Y, and A is monotone, it 



follows that (yi - y 2 , Py* - Py 2 ) = (Pyi - Py 2 ,yt ~ y 2 ) = (yi ~ 2/2, y* ~ yt) > 0. 



(ii) Let B : Y =4 Y be a maximal monotone extension of PA Using [22|, Theorem 18.8] and 



since span dom B = span dom .A = Y, we see that 

inty dom B = inty conv dom B = inty conv dom B (30) 

and that inty conv dom A = inty conv dom A Thus 

inty dom B = inty conv dom B D inty conv dom A = inty conv dom A B 0, (31) 

and hence G inty dom B = ridomP. Since G Y f~l ridomP = ranQ H ridomP, [21| Theo- 
rem 12.43] implies that Q*BQ: X z4 X is maximal monotone. Because domQ*P(5 = Q _1 domP, 
(JO = G inty domP, and Q : X — ► Y is continuous, we see that G int dom(3*-BQ. On the other 
hand, G riD = ridomiV/). Altogether, 

G int dom Q*BQ n ri dom JV D . (32) 

Thus, by [21, Corollary 12.44], 

B = Q*BQ + Nd is maximal monotone. (33) 

We shall now show that B is an extension of A To this end, take (a, a*) G graA Since a G 
dom A C Y, we have Qa = a. Recalling that B extends PA, we deduce that Pa* G PAa C Pa = 
PQa = Q*BQa and so 

Pa* G Q*PQa. (34) 

On the other hand, a G dom A C D C Y ', which implies Y 1 - C Njy(a) and further 

o*-Pa*GiV D (a). (35) 

Adding ([Ml) and ((35J) yields 

a* e(Q*BQ + N D )(a) = Ba. (36) 



Hence (a, a*) £ gr&B and we conclude that 

B is a maximal monotone extension of A. (37) 



By \Z2\ Theorem 18.6], conv domB = domB C domJVc = D. Furthermore, (|37p implies that 
dom A C domB and thus D = conv domyl C conv domi?. Therefore, D = domB. ■ 

Let us now illustrate and compare Theorem 1 2 . 1 3 1 and Theorem 12.151 

Example 2.16 Suppose that X = R, let A = Id.]_x,ir be the identity operator restricted to the 
open interval ]— 1, 1[, and set D = conv dom A = [—1, 1]. Since dom. A is open, we have Ad := 
A + Nd = A. Hence 

A D = A = Id (38) 

by [3 Example 5.10]. Let B be an arbitrary maximal monotone extension of A. Since grai? is 
closed, it follows that B extends Id \d- Hence B + No extends Id+Np, but the latter is already 
maximal monotone. Thus, the operator B provided by Theorem 12 . 15 f(u)] is 



B = ld+N D . (39) 

Therefore, Theorem 12.131 and Theorem 12.151 may in general produce different maximal monotone 
extensions. 



3 Main Results 

We now turn to the extension of (firmly) nonexpansive operators. For recent results in this direction, 
all based on Zorn's Lemma, see [19] ; PQ, and the references therein. 

Theorem 3.1 (constructive extension) Let SCI and let T: S — ► X be nonexpansive. Pro- 
ceed as follows. 

Step 1. SetF := \ld+\T. 

Step 2. Set A := F' 1 - Id. 

Step 3. Compute A as in Fact \2.fA 

Step 4. SetF := (Id+2)" 1 . 

Step 5. Set f := 2F - Id. 

Then T: X — > X is a nonexpansive extension ofT. 



Proof. Since T is nonexpansive, F of Step 1 is firmly nonexpansive (Fact I2.2p . By Fact I2.51 (i). 
A is monotone. Now Fact 12.91 implies that A is a maximal monotone extension of A. Hence, 
by Fact 12.51 F: X ^> X is firmly nonexpansive. Finally, Fact 12.21 yields that T: X — > X is a 
nonexpansive extension of T. ■ 

Example 3.2 Let 5 C I and set T = 0\ s . Then Theorem O returns f = 0. 

Proof. We use the notation of TheoremEJ Then F = \ Id \ s and A = Id | 5 . By Example 5.10], 
1 = Id. Therefore, F = \ Id and f = 0. ■ 

Example 3.3 Let c? and d* be in X, and set S = {d}. Consider the nonexpansive operator 
T: S — > X given by Td = d* . Then Theorem 13.11 returns T = d*. 

Proof Adopting the notation of Theorem 13 .1\ we see that grai 7 = {(d, e)}, where e = ^(d + d*). 
Hence gra A = {(e, d — e)} and Example 12.111 yields A: x >— > x + (d — e) — e = x — d* . It follows 
that F: x* ^\{x* +d*). Therefore, f = d*. U 

We now translate the results on maximal monotone extensions of the previous section to the 
setting of (firmly) nonexpansive mappings. The next two results are constructive counterparts to 
[H Corollary 5] provided some assumption on the range is satisfied. 

Theorem 3.4 Let S C X, and let F: S — > X be firmly nonexpansive. Set D := conv rani 7 , 
A := F~ l — Id, and Ad := A + Nd- Compute Ad, and set F := (Id+Ao) -1 . Then the following 
hold. 

(i) F: X — > X is a firmly nonexpansive extension of F such that fani 7 = conv rani 7 C 

(ii) If conv ran F is closed, then fan F = D. 

Proof. Since ran F = dom A, the result is a direct consequence of Theorem 12.131 ■ 

Theorem 3.5 Suppose that X is finite-dimensional, let S C X, and let F : S — > X be firmly 
nonexpansive. Set D := conv rani 7 and Y := spanD, and assume that 6 liD. Denote the 
orthogonal projector from X onto Y by P. Let B: Y =£ Y be an arbitrary maximal monotone 
extension of PiF' 1 -Id): Y =lY, set B := BP + N D : X =t X , and F := (Id+B)- 1 . Then F is 
a firmly nonexpansive extension of F and rani 7 = D. 

Proof. This is a direct consequence of Theorem 12.151 ■ 

We conclude this paper with a constructive version of the original Kirszbraun- Valentine result. 



Theorem 3.6 (constructive Kirszbraun- Valentine extension) Let S C X and let T: S — > 

X be nonexpansive. Compute T as in Theorem \3.1\ Set D : = conv ranT, and denote the orthogonal 
projector onto D by P. Then PT: X — ► X is a nonexpansive extension ofT such that fan(PT) C 
D. 

Proof. From Theorem 13.11 we know that T : X — > X is a nonexpansive extension of T. Since P is 
nonexpansive, the result follows. ■ 

Remark 3.7 We point out that if the given (firmly) nonexpansive mapping is described by its 
graph, then Remark 12.31 and Remark 12.61 may be used to go back and forth between the (firmly) 
nonexpansive mapping and its full-domain extension, and the corresponding monotone operators, 
respectively. 

Remark 3.8 Let S C X and let F: S — > X be firmly nonexpansive. Then Corollary 12.71 and 
[TJ Corollary 5] - which was proved nonconstructively -- guarantees the existence of a firmly 
nonexpansive extension G: X — > X of F such that ranG = conv rani 7 . We do not know whether 
it is possible to use Theorem 13.61 — or any other constructive result — to obtain such a mapping; 
see also [U Remark 8]. 
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